Pandas Profiling Report

Dataset statistics

Number of variables	15
Number of observations	6362620
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	728.1 MiB
Average record size in memory	120.0 B

Variable types

Numeric	9
Categorical	6

Alerts

`name_orig` has a high cardinality: 6353307 distinct values	High cardinality
`name_dest` has a high cardinality: 2722362 distinct values	High cardinality
`step` is highly correlated with `day`	High correlation
`amount` is highly correlated with `diff_org_balance` and 1 other fields	High correlation
`oldbalance_org` is highly correlated with `newbalance_orig`	High correlation
`newbalance_orig` is highly correlated with `type` and 1 other fields	High correlation
`oldbalance_dest` is highly correlated with `newbalance_dest`	High correlation
`newbalance_dest` is highly correlated with `oldbalance_dest`	High correlation
`diff_org_balance` is highly correlated with `amount` and 1 other fields	High correlation
`diff_dest_balance` is highly correlated with `amount` and 1 other fields	High correlation
`day` is highly correlated with `step`	High correlation
`type` is highly correlated with `newbalance_orig` and 1 other fields	High correlation
`merchant_dest` is highly correlated with `type`	High correlation
`amount` is highly skewed (γ1 = 30.99394948)	Skewed
`diff_org_balance` is highly skewed (γ1 = -30.07475092)	Skewed
`diff_dest_balance` is highly skewed (γ1 = -30.33109298)	Skewed
`name_orig` is uniformly distributed	Uniform
`oldbalance_org` has 2102449 (33.0%) zeros	Zeros
`newbalance_orig` has 3609566 (56.7%) zeros	Zeros
`oldbalance_dest` has 2704388 (42.5%) zeros	Zeros
`newbalance_dest` has 2439433 (38.3%) zeros	Zeros
`diff_org_balance` has 1361836 (21.4%) zeros	Zeros
`diff_dest_balance` has 1032168 (16.2%) zeros	Zeros

Reproduction

Analysis started	2023-01-04 17:57:06.810018
Analysis finished	2023-01-04 18:12:53.428313
Duration	15 minutes and 46.62 seconds
Software version	pandas-profiling v3.4.0
Download configuration	config.json

step
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	743
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	243.3972456

Minimum	1
Maximum	743
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	1
5-th percentile	16
Q1	156
median	239
Q3	335
95-th percentile	490
Maximum	743
Range	742
Interquartile range (IQR)	179

Descriptive statistics

Standard deviation	142.331971
Coefficient of variation (CV)	0.5847723161
Kurtosis	0.329070555
Mean	243.3972456
Median Absolute Deviation (MAD)	92
Skewness	0.3751768885
Sum	1548644183
Variance	20258.38998
Monotonicity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
19	51352	0.8%
18	49579	0.8%
187	49083	0.8%
235	47491	0.7%
307	46968	0.7%
163	46352	0.7%
139	46054	0.7%
403	45155	0.7%
43	45060	0.7%
355	44787	0.7%
Other values (733)	5890739	92.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2708	< 0.1%
2	1014	< 0.1%
3	552	< 0.1%
4	565	< 0.1%
5	665	< 0.1%
6	1660	< 0.1%
7	6837	0.1%
8	21097	0.3%
9	37628	0.6%
10	35991	0.6%

Value	Count	Frequency (%)
743	8	< 0.1%
742	14	< 0.1%
741	22	< 0.1%
740	6	< 0.1%
739	10	< 0.1%
738	10	< 0.1%
737	10	< 0.1%
736	14	< 0.1%
735	12	< 0.1%
734	8	< 0.1%

type
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

CASH_OUT	2237500
PAYMENT	2151495
CASH_IN	1399284
TRANSFER	532909
DEBIT	41432

Length

Max length	8
Median length	7
Mean length	7.422395963
Min length	5

Characters and Unicode

Total characters	47225885
Distinct characters	18
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	PAYMENT
2nd row	PAYMENT
3rd row	TRANSFER
4th row	CASH_OUT
5th row	PAYMENT

Common Values

Value	Count	Frequency (%)
CASH_OUT	2237500	35.2%
PAYMENT	2151495	33.8%
CASH_IN	1399284	22.0%
TRANSFER	532909	8.4%
DEBIT	41432	0.7%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
cash_out	2237500	35.2%
payment	2151495	33.8%
cash_in	1399284	22.0%
transfer	532909	8.4%
debit	41432	0.7%

Most occurring characters

Value	Count	Frequency (%)
A	6321188	13.4%
T	4963336	10.5%
S	4169693	8.8%
N	4083688	8.6%
C	3636784	7.7%
H	3636784	7.7%
_	3636784	7.7%
E	2725836	5.8%
O	2237500	4.7%
U	2237500	4.7%
Other values (8)	9576792	20.3%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	43589101	92.3%
Connector Punctuation	3636784	7.7%

Most frequent character per category

Uppercase Letter

Value	Count	Frequency (%)
A	6321188	14.5%
T	4963336	11.4%
S	4169693	9.6%
N	4083688	9.4%
C	3636784	8.3%
H	3636784	8.3%
E	2725836	6.3%
O	2237500	5.1%
U	2237500	5.1%
Y	2151495	4.9%
Other values (7)	7425297	17.0%

Connector Punctuation

Value	Count	Frequency (%)
_	3636784	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	43589101	92.3%
Common	3636784	7.7%

Most frequent character per script

Latin

Value	Count	Frequency (%)
A	6321188	14.5%
T	4963336	11.4%
S	4169693	9.6%
N	4083688	9.4%
C	3636784	8.3%
H	3636784	8.3%
E	2725836	6.3%
O	2237500	5.1%
U	2237500	5.1%
Y	2151495	4.9%
Other values (7)	7425297	17.0%

Common

Value	Count	Frequency (%)
_	3636784	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	47225885	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
A	6321188	13.4%
T	4963336	10.5%
S	4169693	8.8%
N	4083688	8.6%
C	3636784	7.7%
H	3636784	7.7%
_	3636784	7.7%
E	2725836	5.8%
O	2237500	4.7%
U	2237500	4.7%
Other values (8)	9576792	20.3%

amount
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	5316900
Distinct (%)	83.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	179861.9035

Minimum	0
Maximum	92445516.64
Zeros	16
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	2224.0995
Q1	13389.57
median	74871.94
Q3	208721.4775
95-th percentile	518634.1965
Maximum	92445516.64
Range	92445516.64
Interquartile range (IQR)	195331.9075

Descriptive statistics

Standard deviation	603858.2315
Coefficient of variation (CV)	3.357343715
Kurtosis	1797.956705
Mean	179861.9035
Median Absolute Deviation (MAD)	68393.655
Skewness	30.99394948
Sum	1.144392945 × 10¹²
Variance	3.646447637 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10000000	3207	0.1%
10000	88	< 0.1%
5000	79	< 0.1%
15000	68	< 0.1%
500	65	< 0.1%
100000	42	< 0.1%
21500	37	< 0.1%
120000	29	< 0.1%
135000	20	< 0.1%
0	16	< 0.1%
Other values (5316890)	6358969	99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	16	< 0.1%
0.01	1	< 0.1%
0.02	3	< 0.1%
0.03	2	< 0.1%
0.04	1	< 0.1%
0.06	1	< 0.1%
0.07	1	< 0.1%
0.09	1	< 0.1%
0.1	1	< 0.1%
0.11	2	< 0.1%

Value	Count	Frequency (%)
92445516.64	1	< 0.1%
73823490.36	1	< 0.1%
71172480.42	1	< 0.1%
69886731.3	1	< 0.1%
69337316.27	1	< 0.1%
67500761.29	1	< 0.1%
66761272.21	1	< 0.1%
64234448.19	1	< 0.1%
63847992.58	1	< 0.1%
63294839.63	1	< 0.1%

name_orig
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	6353307
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

C1902386530	3
C363736674	3
C545315117	3
C724452879	3
C1784010646	3
Other values (6353302)	6362605

Length

Max length	11
Median length	11
Mean length	10.48232332
Min length	5

Characters and Unicode

Total characters	66695040
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	6344009 ?
Unique (%)	99.7%

Sample

1st row	C1231006815
2nd row	C1666544295
3rd row	C1305486145
4th row	C840083671
5th row	C2048537720

Common Values

Value	Count	Frequency (%)
C1902386530	3	< 0.1%
C363736674	3	< 0.1%
C545315117	3	< 0.1%
C724452879	3	< 0.1%
C1784010646	3	< 0.1%
C1677795071	3	< 0.1%
C1462946854	3	< 0.1%
C1999539787	3	< 0.1%
C2098525306	3	< 0.1%
C400299098	3	< 0.1%
Other values (6353297)	6362590	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
c1902386530	3	< 0.1%
c2098525306	3	< 0.1%
c363736674	3	< 0.1%
c1530544995	3	< 0.1%
c1065307291	3	< 0.1%
c2051359467	3	< 0.1%
c1832548028	3	< 0.1%
c400299098	3	< 0.1%
c1976208114	3	< 0.1%
c1999539787	3	< 0.1%
Other values (6353297)	6362590	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	8803448	13.2%
C	6362620	9.5%
2	6136135	9.2%
3	5699596	8.5%
4	5693146	8.5%
7	5669437	8.5%
5	5668010	8.5%
6	5667725	8.5%
0	5667074	8.5%
9	5665212	8.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	60332420	90.5%
Uppercase Letter	6362620	9.5%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	8803448	14.6%
2	6136135	10.2%
3	5699596	9.4%
4	5693146	9.4%
7	5669437	9.4%
5	5668010	9.4%
6	5667725	9.4%
0	5667074	9.4%
9	5665212	9.4%
8	5662637	9.4%

Uppercase Letter

Value	Count	Frequency (%)
C	6362620	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	60332420	90.5%
Latin	6362620	9.5%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	8803448	14.6%
2	6136135	10.2%
3	5699596	9.4%
4	5693146	9.4%
7	5669437	9.4%
5	5668010	9.4%
6	5667725	9.4%
0	5667074	9.4%
9	5665212	9.4%
8	5662637	9.4%

Latin

Value	Count	Frequency (%)
C	6362620	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66695040	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	8803448	13.2%
C	6362620	9.5%
2	6136135	9.2%
3	5699596	8.5%
4	5693146	8.5%
7	5669437	8.5%
5	5668010	8.5%
6	5667725	8.5%
0	5667074	8.5%
9	5665212	8.5%

oldbalance_org
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	1845844
Distinct (%)	29.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	833883.1041

Minimum	0
Maximum	59585040.37
Zeros	2102449
Zeros (%)	33.0%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	14208
Q3	107315.175
95-th percentile	5823702.278
Maximum	59585040.37
Range	59585040.37
Interquartile range (IQR)	107315.175

Descriptive statistics

Standard deviation	2888242.673
Coefficient of variation (CV)	3.46360618
Kurtosis	32.96487854
Mean	833883.1041
Median Absolute Deviation (MAD)	14208
Skewness	5.249136421
Sum	5.305681316 × 10¹²
Variance	8.341945738 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2102449	33.0%
184	918	< 0.1%
133	914	< 0.1%
195	912	< 0.1%
164	909	< 0.1%
181	908	< 0.1%
109	908	< 0.1%
157	902	< 0.1%
146	899	< 0.1%
128	898	< 0.1%
Other values (1845834)	4252003	66.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2102449	33.0%
0.05	1	< 0.1%
0.18	1	< 0.1%
0.21	1	< 0.1%
0.44	1	< 0.1%
0.67	1	< 0.1%
1	370	< 0.1%
1.02	1	< 0.1%
1.37	1	< 0.1%
1.38	1	< 0.1%

Value	Count	Frequency (%)
59585040.37	1	< 0.1%
57316255.05	1	< 0.1%
50399045.08	1	< 0.1%
49585040.37	1	< 0.1%
47316255.05	1	< 0.1%
45674547.89	1	< 0.1%
44892193.09	1	< 0.1%
43818855.3	1	< 0.1%
43686616.33	1	< 0.1%
42542664.27	1	< 0.1%

newbalance_orig
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	2682586
Distinct (%)	42.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	855113.6686

Minimum	0
Maximum	49585040.37
Zeros	3609566
Zeros (%)	56.7%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	144258.41
95-th percentile	5980262.336
Maximum	49585040.37
Range	49585040.37
Interquartile range (IQR)	144258.41

Descriptive statistics

Standard deviation	2924048.503
Coefficient of variation (CV)	3.419485164
Kurtosis	32.06698456
Mean	855113.6686
Median Absolute Deviation (MAD)	0
Skewness	5.176884001
Sum	5.44076333 × 10¹²
Variance	8.550059648 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	3609566	56.7%
5888.64	4	< 0.1%
15073.44	4	< 0.1%
5122	4	< 0.1%
36875.73	4	< 0.1%
10528.49	4	< 0.1%
904.13	4	< 0.1%
18392.51	4	< 0.1%
32926.52	4	< 0.1%
4277.69	4	< 0.1%
Other values (2682576)	2753018	43.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	3609566	56.7%
0.01	1	< 0.1%
0.03	1	< 0.1%
0.05	1	< 0.1%
0.12	1	< 0.1%
0.13	1	< 0.1%
0.18	1	< 0.1%
0.21	1	< 0.1%
0.23	1	< 0.1%
0.3	1	< 0.1%

Value	Count	Frequency (%)
49585040.37	1	< 0.1%
47316255.05	1	< 0.1%
43686616.33	1	< 0.1%
43673802.21	1	< 0.1%
41690842.64	1	< 0.1%
41432359.46	1	< 0.1%
40399045.08	1	< 0.1%
39585040.37	1	< 0.1%
38946233.02	1	< 0.1%
38939424.03	1	< 0.1%

name_dest
Categorical

HIGH CARDINALITY

Distinct	2722362
Distinct (%)	42.8%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

C1286084959	113
C985934102	109
C665576141	105
C2083562754	102
C248609774	101
Other values (2722357)	6362090

Length

Max length	11
Median length	11
Mean length	10.48175201
Min length	2

Characters and Unicode

Total characters	66691405
Distinct characters	12
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	2262704 ?
Unique (%)	35.6%

Sample

1st row	M1979787155
2nd row	M2044282225
3rd row	C553264065
4th row	C38997010
5th row	M1230701703

Common Values

Value	Count	Frequency (%)
C1286084959	113	< 0.1%
C985934102	109	< 0.1%
C665576141	105	< 0.1%
C2083562754	102	< 0.1%
C248609774	101	< 0.1%
C1590550415	101	< 0.1%
C451111351	99	< 0.1%
C1789550256	99	< 0.1%
C1360767589	98	< 0.1%
C1023714065	97	< 0.1%
Other values (2722352)	6361596	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
c1286084959	113	< 0.1%
c985934102	109	< 0.1%
c665576141	105	< 0.1%
c2083562754	102	< 0.1%
c248609774	101	< 0.1%
c1590550415	101	< 0.1%
c451111351	99	< 0.1%
c1789550256	99	< 0.1%
c1360767589	98	< 0.1%
c1023714065	97	< 0.1%
Other values (2722352)	6361596	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	8799996	13.2%
2	6133780	9.2%
3	5704404	8.6%
4	5691070	8.5%
8	5675627	8.5%
9	5668861	8.5%
7	5665128	8.5%
0	5664751	8.5%
6	5662897	8.5%
5	5662271	8.5%
Other values (2)	6362620	9.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	60328785	90.5%
Uppercase Letter	6362620	9.5%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	8799996	14.6%
2	6133780	10.2%
3	5704404	9.5%
4	5691070	9.4%
8	5675627	9.4%
9	5668861	9.4%
7	5665128	9.4%
0	5664751	9.4%
6	5662897	9.4%
5	5662271	9.4%

Uppercase Letter

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring scripts

Value	Count	Frequency (%)
Common	60328785	90.5%
Latin	6362620	9.5%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	8799996	14.6%
2	6133780	10.2%
3	5704404	9.5%
4	5691070	9.4%
8	5675627	9.4%
9	5668861	9.4%
7	5665128	9.4%
0	5664751	9.4%
6	5662897	9.4%
5	5662271	9.4%

Latin

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66691405	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	8799996	13.2%
2	6133780	9.2%
3	5704404	8.6%
4	5691070	8.5%
8	5675627	8.5%
9	5668861	8.5%
7	5665128	8.5%
0	5664751	8.5%
6	5662897	8.5%
5	5662271	8.5%
Other values (2)	6362620	9.5%

oldbalance_dest
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	3614697
Distinct (%)	56.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1100701.667

Minimum	0
Maximum	356015889.4
Zeros	2704388
Zeros (%)	42.5%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	132705.665
Q3	943036.7075
95-th percentile	5147229.713
Maximum	356015889.4
Range	356015889.4
Interquartile range (IQR)	943036.7075

Descriptive statistics

Standard deviation	3399180.113
Coefficient of variation (CV)	3.088193846
Kurtosis	948.6741254
Mean	1100701.667
Median Absolute Deviation (MAD)	132705.665
Skewness	19.92175792
Sum	7.003346437 × 10¹²
Variance	1.155442544 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2704388	42.5%
10000000	615	< 0.1%
20000000	219	< 0.1%
30000000	86	< 0.1%
40000000	31	< 0.1%
102	21	< 0.1%
198	19	< 0.1%
125	18	< 0.1%
160	18	< 0.1%
132	18	< 0.1%
Other values (3614687)	3657187	57.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2704388	42.5%
0.01	1	< 0.1%
0.03	1	< 0.1%
0.13	1	< 0.1%
0.33	1	< 0.1%
0.37	1	< 0.1%
0.79	1	< 0.1%
1	7	< 0.1%
1.39	1	< 0.1%
1.64	1	< 0.1%

Value	Count	Frequency (%)
356015889.4	1	< 0.1%
355553416.3	1	< 0.1%
355381433.6	1	< 0.1%
355380483.5	1	< 0.1%
355185537.1	1	< 0.1%
328194464.9	1	< 0.1%
327998074.2	1	< 0.1%
327963024	1	< 0.1%
327852121.4	1	< 0.1%
327827763.4	1	< 0.1%

newbalance_dest
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	3555499
Distinct (%)	55.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1224996.398

Minimum	0
Maximum	356179278.9
Zeros	2439433
Zeros (%)	38.3%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	214661.44
Q3	1111909.25
95-th percentile	5515715.903
Maximum	356179278.9
Range	356179278.9
Interquartile range (IQR)	1111909.25

Descriptive statistics

Standard deviation	3674128.942
Coefficient of variation (CV)	2.999297751
Kurtosis	862.1565079
Mean	1224996.398
Median Absolute Deviation (MAD)	214661.44
Skewness	19.35230206
Sum	7.794186583 × 10¹²
Variance	1.349922348 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2439433	38.3%
10000000	53	< 0.1%
971418.91	32	< 0.1%
19169204.93	29	< 0.1%
1254956.07	25	< 0.1%
16532032.16	25	< 0.1%
1412484.09	22	< 0.1%
4743010.67	21	< 0.1%
1178808.14	21	< 0.1%
7364724.84	21	< 0.1%
Other values (3555489)	3922938	61.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2439433	38.3%
0.01	1	< 0.1%
0.33	1	< 0.1%
1.39	1	< 0.1%
1.64	1	< 0.1%
1.74	1	< 0.1%
2.15	1	< 0.1%
2.45	1	< 0.1%
2.71	1	< 0.1%
2.76	1	< 0.1%

Value	Count	Frequency (%)
356179278.9	1	< 0.1%
356015889.4	1	< 0.1%
355553416.3	2	< 0.1%
355381433.6	1	< 0.1%
355380483.5	1	< 0.1%
355185537.1	1	< 0.1%
328431698.2	1	< 0.1%
328194464.9	1	< 0.1%
327998074.2	1	< 0.1%
327963024	1	< 0.1%

is_fraud
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

0	6354407
1	8213

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	1
4th row	1
5th row	0

Common Values

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring characters

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6362620	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	6362620	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

is_flagged_fraud
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

0	6362604
1	16

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6362620	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	6362620	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

diff_org_balance
Real number (ℝ)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	907958
Distinct (%)	14.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-201092.08

Minimum	-92445516
Maximum	0
Zeros	1361836
Zeros (%)	21.4%
Negative	5000784
Negative (%)	78.6%
Memory size	48.5 MiB

Quantile statistics

Minimum	-92445516
5-th percentile	-700716.05
Q1	-249640.25
median	-68677
Q3	-2954
95-th percentile	0
Maximum	0
Range	92445516
Interquartile range (IQR)	246686.25

Descriptive statistics

Standard deviation	606650.429
Coefficient of variation (CV)	-3.016779324
Kurtosis	1753.268826
Mean	-201092.08
Median Absolute Deviation (MAD)	68677
Skewness	-30.07475092
Sum	-1.27947249 × 10¹²
Variance	3.68024743 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1361836	21.4%
-10000000	1085	< 0.1%
-1000	168	< 0.1%
-10000	133	< 0.1%
-20000	121	< 0.1%
-84	108	< 0.1%
-1944	108	< 0.1%
-2514	105	< 0.1%
-1982	105	< 0.1%
-510	104	< 0.1%
Other values (907948)	4998747	78.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-92445516	1	< 0.1%
-73823490	1	< 0.1%
-71172480	1	< 0.1%
-69886731	1	< 0.1%
-69337316	1	< 0.1%
-67500761	1	< 0.1%
-66761272	1	< 0.1%
-64234448	1	< 0.1%
-63847992	1	< 0.1%
-63294839	1	< 0.1%

Value	Count	Frequency (%)
0	1361836	21.4%
-1	65	< 0.1%
-2	70	< 0.1%
-3	59	< 0.1%
-4	59	< 0.1%
-5	71	< 0.1%
-6	83	< 0.1%
-7	85	< 0.1%
-8	79	< 0.1%
-9	71	< 0.1%

diff_dest_balance
Real number (ℝ)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	1197049
Distinct (%)	18.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-304156.2303

Minimum	-184891033
Maximum	12930418
Zeros	1032168
Zeros (%)	16.2%
Negative	5273086
Negative (%)	82.9%
Memory size	48.5 MiB

Quantile statistics

Minimum	-184891033
5-th percentile	-1056983.3
Q1	-308391
median	-27748
Q3	-3815
95-th percentile	0
Maximum	12930418
Range	197821451
Interquartile range (IQR)	304576

Descriptive statistics

Standard deviation	1362380.9
Coefficient of variation (CV)	-4.479214182
Kurtosis	1554.520049
Mean	-304156.2303
Median Absolute Deviation (MAD)	27748
Skewness	-30.33109298
Sum	-1.935230514 × 10¹²
Variance	1.856081717 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1032168	16.2%
-2216	168	< 0.1%
-1181	168	< 0.1%
-1005	166	< 0.1%
-1339	166	< 0.1%
-1722	166	< 0.1%
-2752	166	< 0.1%
-497	165	< 0.1%
-1797	165	< 0.1%
-1259	165	< 0.1%
Other values (1197039)	5328957	83.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-184891033	1	< 0.1%
-164559608	1	< 0.1%
-147646980	1	< 0.1%
-142344960	1	< 0.1%
-139773462	1	< 0.1%
-138674632	1	< 0.1%
-135767972	1	< 0.1%
-135489952	1	< 0.1%
-135001522	1	< 0.1%
-133522544	1	< 0.1%

Value	Count	Frequency (%)
12930418	1	< 0.1%
9385209	1	< 0.1%
5672835	1	< 0.1%
5315828	1	< 0.1%
5263390	1	< 0.1%
5114161	1	< 0.1%
4834325	1	< 0.1%
4755039	1	< 0.1%
4565838	1	< 0.1%
4525018	1	< 0.1%

merchant_dest
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

0	4211125
1	2151495

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	1
3rd row	0
4th row	0
5th row	1

Common Values

Value	Count	Frequency (%)
0	4211125	66.2%
1	2151495	33.8%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0	4211125	66.2%
1	2151495	33.8%

Most occurring characters

Value	Count	Frequency (%)
0	4211125	66.2%
1	2151495	33.8%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6362620	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	4211125	66.2%
1	2151495	33.8%

Most occurring scripts

Value	Count	Frequency (%)
Common	6362620	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	4211125	66.2%
1	2151495	33.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	4211125	66.2%
1	2151495	33.8%

day
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	31
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10.49190679

Minimum	1
Maximum	31
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	7
median	10
Q3	14
95-th percentile	21
Maximum	31
Range	30
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	5.921812248
Coefficient of variation (CV)	0.5644171612
Kurtosis	0.3323014534
Mean	10.49190679
Median Absolute Deviation (MAD)	4
Skewness	0.3778477393
Sum	66756016
Variance	35.0678603
Monotonicity	Increasing

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
1	574255	9.0%
2	455238	7.2%
8	449637	7.1%
6	441005	6.9%
13	428583	6.7%
17	425766	6.7%
7	420583	6.6%
9	417919	6.6%
11	417859	6.6%
15	401282	6.3%
Other values (21)	1930493	30.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	574255	9.0%
2	455238	7.2%
3	1070	< 0.1%
4	28240	0.4%
5	9789	0.2%
6	441005	6.9%
7	420583	6.6%
8	449637	7.1%
9	417919	6.6%
10	392945	6.2%

Value	Count	Frequency (%)
31	272	< 0.1%
30	11287	0.2%
29	54890	0.9%
28	14661	0.2%
27	8578	0.1%
26	13885	0.2%
25	57853	0.9%
24	32709	0.5%
23	51012	0.8%
22	53437	0.8%

Auto

The auto setting is an easily interpretable pairwise column metric of the following mapping: vartype-vartype : method, categorical-categorical : Cramer's V, numerical-categorical : Cramer's V (using a discretized numerical column), numerical-numerical : Spearman's ρ. This configuration uses the best suitable for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	step	type	amount	name_orig	oldbalance_org	newbalance_orig	name_dest	oldbalance_dest	newbalance_dest	is_fraud	diff_org_balance	diff_dest_balance	merchant_dest	day
0	1	PAYMENT	9839.6400	C1231006815	170136.0000	160296.3600	M1979787155	0.0000	0.0000	0	0	-9839	1	1
1	1	PAYMENT	1864.2800	C1666544295	21249.0000	19384.7200	M2044282225	0.0000	0.0000	0	0	-1864	1	1
2	1	TRANSFER	181.0000	C1305486145	181.0000	0.0000	C553264065	0.0000	0.0000	1	0	-181	0	1
3	1	CASH_OUT	181.0000	C840083671	181.0000	0.0000	C38997010	21182.0000	0.0000	1	0	21001	0	1
4	1	PAYMENT	11668.1400	C2048537720	41554.0000	29885.8600	M1230701703	0.0000	0.0000	0	0	-11668	1	1
5	1	PAYMENT	7817.7100	C90045638	53860.0000	46042.2900	M573487274	0.0000	0.0000	0	0	-7817	1	1
6	1	PAYMENT	7107.7700	C154988899	183195.0000	176087.2300	M408069119	0.0000	0.0000	0	0	-7107	1	1
7	1	PAYMENT	7861.6400	C1912850431	176087.2300	168225.5900	M633326333	0.0000	0.0000	0	0	-7861	1	1
8	1	PAYMENT	4024.3600	C1265012928	2671.0000	0.0000	M1176932104	0.0000	0.0000	0	-1353	-4024	1	1
9	1	DEBIT	5337.7700	C712410124	41720.0000	36382.2300	C195600860	41898.0000	40348.7900	0	0	-3788	0	1

Last rows

	step	type	amount	name_orig	oldbalance_org	name_dest	oldbalance_dest	newbalance_dest	is_fraud	diff_dest_balance	day
6362610	742	TRANSFER	63416.9900	C778071008	63416.9900	C1812552860	0.0000	0.0000	1	-63416	31
6362611	742	CASH_OUT	63416.9900	C994950684	63416.9900	C1662241365	276433.1800	339850.1700	1	-126833	31
6362612	743	TRANSFER	1258818.8200	C1531301470	1258818.8200	C1470998563	0.0000	0.0000	1	-1258818	31
6362613	743	CASH_OUT	1258818.8200	C1436118706	1258818.8200	C1240760502	503464.5000	1762283.3300	1	-2517637	31
6362614	743	TRANSFER	339682.1300	C2013999242	339682.1300	C1850423904	0.0000	0.0000	1	-339682	31
6362615	743	CASH_OUT	339682.1300	C786484425	339682.1300	C776919290	0.0000	339682.1300	1	-679364	31
6362616	743	TRANSFER	6311409.2800	C1529008245	6311409.2800	C1881841831	0.0000	0.0000	1	-6311409	31
6362617	743	CASH_OUT	6311409.2800	C1162922333	6311409.2800	C1365125890	68488.8400	6379898.1100	1	-12622818	31
6362618	743	TRANSFER	850002.5200	C1685995037	850002.5200	C2080388513	0.0000	0.0000	1	-850002	31
6362619	743	CASH_OUT	850002.5200	C1280323807	850002.5200	C873221189	6510099.1100	7360101.6300	1	-1700005	31

Overview

Variables

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Uppercase Letter

Connector Punctuation

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Uppercase Letter

Most occurring scripts

Most frequent character per script

Common

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Uppercase Letter

Most occurring scripts

Most frequent character per script

Common

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script